Touch panel device, bending control program, recording medium including bending control program recorded therein, and endoscope bending control method

ABSTRACT

The disclosed technology is directed to a touch panel device used in an endoscope device. The touch panel device includes a display portion having a display panel and a touch panel formed thereto and configured to display an endoscope image on the display panel acquired by an endoscope having a bending portion. A processor is configured to control the bending portion so as to perform a bending operation when a user keeps performing a first operation on the touch panel in a first predetermined duration or more.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a Non-provisional application which claim priorityto the Japanese Patent Application No. 2018-064865 filed in the JapanPatent Office on Mar. 29, 2018, which is hereby incorporated byreference in its entirety.

TECHNICAL FIELD

The disclosed technology relates to a touch panel device, a bendingcontrol program, a recording medium including the bending controlprogram recorded therein, and an endoscope bending control method.

DESCRIPTION OF THE RELATED ART

A known endoscope device displays, on a monitor, an endoscope image ofinside of an object taken using an insertion portion inserted into theobject. For example, Japanese Patent Laid-Open No. 2005-52635 disclosesan endoscope device displaying an endoscope image and a manipulationimage on a monitor. In this endoscope device, a bending portion of aninsertion portion of the endoscope displayed on the manipulation imageis manipulated by operating a keyboard or mouse. A distal end portion ofthe insertion portion is directed toward the object according to aninput of bending instruction and images the object. An endoscope imageresulting from the imaging is displayed on the monitor.

Another known example is a touch panel allowing various instructions tobe input by touch panel operation on a displayed image. The touch panelmay be used to input various instructions for the endoscope device.

BRIEF SUMMARY OF EMBODIMENTS

However, the known endoscope device has disadvantages. For example, amanipulation image may be displayed on the touch panel, so that thebending portion of the insertion portion can be manipulated byperforming touch panel operation on the manipulation image. In such acase, when a user bends the insertion portion, the user's eyes shiftfrom the endoscope image to the manipulation image to allow the positionof the manipulation image to be checked. Achieving accurate manipulationwhile gazing the endoscope image is thus difficult.

An object of the disclosed technology is thus to provide a touch paneldevice, a bending control program, a recording medium including thebending control program recorded therein, and an endoscope bendingcontrol method, all of which allow the bending portion of the insertionportion to be more accurately manipulated with no need to shift theuser's eyes to the manipulation image and with the user's eyes fixed atthe endoscope image.

A touch panel device according to an aspect of the disclosed technologyincludes a display portion including a touch panel and configured todisplay a display screen including an endoscope image acquired by anendoscope with a bending portion, and a control portion configured tocontrollably cause the bending portion to perform a bending operationwhen a first operation lasting a predetermined duration or more fromtouch start until touch end is performed on the display screen.

A bending control program according to an aspect of the disclosedtechnology causes a computer to execute a code displaying, on a displayportion with a touch panel, a display screen including an endoscopeimage acquired by an endoscope with a bending portion, and a codecontrollably causing the bending portion to perform a bending operationwhen a first operation lasting a predetermined duration or more fromtouch start until touch end is performed on the display screen.

A recording medium according to an aspect of the disclosed technologyincludes a bending control program recorded therein, the bending controlprogram causing a computer to execute a code displaying, on a displayportion with a touch panel, a display screen including an endoscopeimage acquired by an endoscope with a bending portion, and a codecontrollably causing the bending portion to perform a bending operationwhen a first operation lasting a predetermined duration or more fromtouch start until touch end is performed on the display screen.

An endoscope bending control method according to an aspect of thedisclosed technology includes preparing a display portion with a touchpanel displaying a display screen, displaying, on the display portion,the display screen including an endoscope image acquired by an endoscopewith a bending portion, and controllably causing the bending portion toperform a bending operation when a first operation lasting apredetermined duration or more from touch start until touch end isperformed on the display screen.

The disclosed technology can provide a touch panel device, a bendingcontrol program, a recording medium including the bending controlprogram recorded therein, and an endoscope bending control method, allof which allow the bending portion of the insertion portion to be moreaccurately manipulated with no need to shift the user's eyes to themanipulation image and with the user's eyes fixed at the endoscopeimage.

BRIEF DESCRIPTION OF THE DRAWINGS

The technology disclosed herein, in accordance with one or more variousembodiments, is described in detail with reference to the followingfigures. The drawings are provided for purposes of illustration only andmerely depict typical or example embodiments of the disclosedtechnology. These drawings are provided to facilitate the reader'sunderstanding of the disclosed technology and shall not be consideredlimiting of the breadth, scope, or applicability thereof. It should benoted that for clarity and ease of illustration these drawings are notnecessarily made to scale.

FIG. 1 is a block diagram illustrating an example of a configuration ofa touch panel device according to a first embodiment of the disclosedtechnology;

FIG. 2 is a diagram illustrating an example of a display screendisplayed on a display portion of a touch panel device according to thefirst embodiment of the disclosed technology;

FIG. 3 is a diagram illustrating a bending instruction area and abending stop area of the touch panel device according to the firstembodiment of the disclosed technology;

FIG. 4 is a diagram illustrating the bending instruction area and thebending stop area of the touch panel device according to the firstembodiment of the disclosed technology;

FIG. 5 is a diagram illustrating the bending instruction area and thebending stop area of the touch panel device according to the firstembodiment of the disclosed technology;

FIG. 6 is a flowchart illustrating an example of a bending controlprocess of the touch panel device according to the first embodiment ofthe disclosed technology;

FIG. 7 is a diagram illustrating an example of a first operation of thetouch panel device according to the first embodiment of the disclosedtechnology;

FIG. 8 is a diagram illustrating an example of a second operation of thetouch panel device according to the first embodiment of the disclosedtechnology;

FIG. 9 is a diagram illustrating an example of the first operation ofthe touch panel device according to a modified example of the firstembodiment of the disclosed technology;

FIG. 10 is a diagram illustrating an example of the second operation ofthe touch panel device according to the modified example of the firstembodiment of the disclosed technology;

FIG. 11 is a flowchart illustrating an example of the bending controlprocess of the touch panel device according to a second embodiment ofthe disclosed technology;

FIG. 12 is a diagram illustrating an example of the first operation ofthe touch panel device according to the second embodiment of thedisclosed technology;

FIG. 13 is a diagram illustrating an example of the second operation ofthe touch panel device according to the second embodiment of thedisclosed technology;

FIG. 14 is a diagram illustrating an example of the first operation ofthe touch panel device according to a modified example of the secondembodiment of the disclosed technology;

FIG. 15 is a diagram illustrating an example of the second operation ofthe touch panel device according to the modified example of the secondembodiment of the disclosed technology;

FIG. 16 is a flowchart illustrating an example of the bending controlprocess of the touch panel device according to a third embodiment of thedisclosed technology;

FIG. 17 is a diagram illustrating an example of the first operation ofthe touch panel device according to the third embodiment of thedisclosed technology;

FIG. 18 is a diagram illustrating an example of the second operation ofthe touch panel device according to the third embodiment of thedisclosed technology;

FIG. 19 is a diagram illustrating an example of the first operation ofthe touch panel device according to a modified example of the thirdembodiment of the disclosed technology; and

FIG. 20 is a diagram illustrating an example of the second operation ofthe touch panel device according to the modified example of the thirdembodiment of the disclosed technology.

DETAILED DESCRIPTION OF THE EMBODIMENTS

In the following description, various embodiments of the technology willbe described. For purposes of explanation, specific configurations anddetails are set forth in order to provide a thorough understanding ofthe embodiments. However, it will also be apparent to one skilled in theart that the technology disclosed herein may be practiced without thespecific details. Furthermore, well-known features may be omitted orsimplified in order not to obscure the embodiment being described.

Embodiments of the disclosed technology will be described below withreference to the drawings.

Configuration of First Embodiment

FIG. 1 is a block diagram illustrating an example of a configuration ofa touch panel device 31 according to a first embodiment of the disclosedtechnology.

An endoscope device 1 includes an insertion portion 11, an endoscope 21,and the touch panel device 31.

The insertion portion 11 has an elongate shape enabling the insertionportion 11 to be inserted into an object. The insertion portion 11includes an optical adapter 12, an imaging portion 13, and a bendingportion 14.

The optical adapter 12 is installed at a distal end portion of theinsertion portion 11. The optical adapter 12 is replaceable depending onthe object. The optical adapter 12 includes an observation window and anoptical system to project return light from the object on the imagingportion 13.

The imaging portion 13 is disposed at the distal end portion of theinsertion portion 11. The imaging portion 13 includes an imaging elementincluding a complementary metal-oxide semiconductor (CMOS) or acharge-coupled device (CCD) to image the object. The imaging portion 13converts an object image input via the optical adapter 12 into animaging signal to output the imaging signal to the endoscope 21.

The bending portion 14 is disposed at a proximal end side of the imagingportion 13 and bent under the control of the endoscope 21.

The insertion portion 11 may include a lighting portion (notillustrated) at the distal end portion thereof to light the object.

The endoscope 21 is attached to the distal end portion of the insertionportion 11. The endoscope 21 includes an image processing portion 15, abending driving portion 16, and an operating portion 17.

The image processing portion 15 executes image processing on an imagingsignal input from the imaging portion 13 to generate an endoscope imageX. The image processing portion 15 then outputs the endoscope image X tothe touch panel device 31.

The bending driving portion 16 is coupled to the bending portion 14 by aplurality of pulling members that bend the bending portion 14. Thebending driving portion 16 pulls the pulling members to bend the bendingportion 14 in a direction corresponding to a bending instruction inputfrom the touch panel device 31.

For example, when a bending instruction instructing upward bending isinput, the bending driving portion 16 pulls an upward-bending pullingmember to bend the bending portion 14 upward such that the distal endportion of the insertion portion 11 is bent upward with respect to aninsertion direction. Similarly, when a bending instruction instructingdownward bending, leftward bending, or rightward bending is input, thebending driving portion 16 bends the bending portion 14 downward,leftward, or rightward according to the bending instruction.

The bending driving portion 16 also pulls, by a predetermined pullingamount, two of the pulling members for bending the bending portion 14 indifferent directions. The bending driving portion 16 can thus causebending of the bending portion 14 in a desired direction other than thefour directions, for example, upward and leftward bending, downward andleftward bending, upward and rightward bending, and downward andrightward bending.

The bending driving portion 16 can further bend the bending portion 14so as to rotate the distal end portion of the insertion portion 11around the bending portion 14, according to the bending instruction fromthe touch panel device 31.

The operating portion 17 includes operating tools such as a freezebutton, a release button, a joystick, a zoom button, and a menu button.A user operates the operating portion 17 to input various instructions.

The touch panel device 31 is connected to the endoscope 21 by a cableCb. The touch panel device 31 includes a display portion 22, anoperating portion 23, an external I/F 24, and a control portion 25. Thetouch panel device 31 may be configured integrally with the endoscope21.

The display portion 22 includes a display panel 22 a and a touch panel22 b.

The display panel 22 a includes, for example, a liquid crystal display(LCD) or an organic light emitting diode (OLED) to display a displayscreen Y input from the control portion 25.

The touch panel 22 b is disposed in superimposition with the displaypanel 22 a to output input of the user's various instructions thereon tothe control portion 25.

The operating portion 23 includes operating tools such as a freezebutton, a release button, a joy stick, a zoom button, and a menu button.

The external I/F 24 is a circuit for external connection. The endoscopedevice 1 can be connected, by the external I/F 24, to an externalstorage device such as a memory card Mc. The endoscope device 1 alsoperforms by wired or wireless communication using the external I/F 24.The endoscope device 1 can be connected, via a network, to a tabletterminal Tb or to an external terminal device such as a server Sv.

The control portion 25 controls operation of each of the portions in theendoscope device 1. The control portion 25 includes a processor 25 a anda storage portion 25 b. The control portion 25 generates, based on theendoscope image X input from the image processing portion 15, thedisplay screen Y to be displayed on the display portion 22. The controlportion 25 outputs the display screen Y to the display portion 22.

The processor 25 a can execute various programs loaded from the storageportion 25 b, the external storage device, or the external terminaldevice. Functions of the control portion 25 are implemented by theprocessor 25 a by executing the corresponding programs. Furthermore,some or all of the functions of the control portion 25 may be configuredusing, for example, a circuit with a field programmable gate array(FPGA) or an application specific integrated circuit (ASIC).

The storage portion 25 b includes a rewritable storage element such as arandom access memory (RAM), a read only memory (ROM), or a flash memory.The storage portion 25 b stores programs and data used to controloperation of each of the portions in the endoscope device 1.

A bending control portion P is also stored in the storage portion 25 b.The bending control portion P includes codes of a bending controlprocess for controlling the bending driving portion 16 according toinstructions input via the touch panel 22 b.

Configuration of Display Screen Y

A configuration of the display screen Y displayed on the display portion22 will now be described.

FIG. 2 is a diagram illustrating an example of the display screen Ydisplayed on the display portion 22 of the touch panel device 31according to the first embodiment of the disclosed technology. FIGS. 3to 5 are diagrams illustrating a bending instruction area Y1 and abending stop area Y2 of the touch panel device 31 according to the firstembodiment of the disclosed technology.

On the display screen Y, instructions can be input by a first operationand a second operation.

The first operation is an operation performed by keeping the user'sfinger F in touch with the touch panel 22 b for a predetermined durationor more. The first operation includes a swipe operation of sliding thefinger F on the touch panel 22 b and a long tap operation of keeping intouch with the touch panel 22 b at one point.

The second operation is an operation performed by putting the user'sfinger F in touch with the touch panel 22 b for less than thepredetermined duration. The second operation includes a tap operation oftapping the touch panel 22 b with the finger F.

As illustrated in FIG. 2, the display screen Y includes the endoscopeimage X, the bending instruction area Y1, used as a first area, thebending stop area Y2, used as a second area, a centering area C, and amenu area Mn.

The endoscope image X imaged by the imaging portion 13 is arranged onthe display screen Y. In an example in FIG. 2, a turbine blade isillustrated as an example of the endoscope image X.

The bending instruction area Y1 is disposed at a predetermined positionon the display screen Y. In the example in FIG. 2, the bendinginstruction area Y1 is disposed in a lower right part of the endoscopeimage X. However, instead of in the lower right part, the bendinginstruction area Y1 may be disposed in any other part of the displayscreen Y.

As illustrated in FIG. 3, the bending instruction area Y1 is disposedlike a ring. The bending instruction area Y1 includes a bendinginstruction pattern R1 that is visible to the user. The bendinginstruction pattern R1 is disposed between an outer edge Y1 o and aninner edge Y1 i of the bending instruction area Y1 and is disposed to bea ring concentric with the bending instruction area Y1. Directioninstruction patterns R2 indicating bending directions are disposed onthe bending instruction pattern R1. In an example in FIG. 3, thedirection instruction patterns R2 include eight triangles arranged atequal intervals in a circumferential direction and respectivelyindicating an upward direction, a downward direction, a leftwarddirection, a rightward direction, and oblique directions. That is, thedisplay screen Y includes the bending instruction area Y1 including thedirection instruction patterns R2 indicating the bending directions. Thebending instruction pattern R1 and the direction instruction patterns R2are manipulation images used to manipulate the bending portion 14.

In the bending instruction area Y1, a bending instruction can be inputby the user's first operation. In the bending instruction area Y1, thebending direction in the bending instruction is input according to atouch position in the circumferential direction.

The bending stop area Y2 is disposed inside of the bending instructionarea Y1 disposed like a ring. In the bending stop area Y2, aninstruction to stop bending of the bending portion 14 can be inputaccording to the first operation. The control portion 25 stops a bendingoperation of the bending portion 14 when the first operation isperformed on the bending stop area Y2. The bending stop area Y2 isdisposed inside the bending instruction area Y1 but may be disposed bothinside and outside the bending instruction area Y1.

In the centering area C, a centering instruction to straighten and placethe bending portion 14 in a neutral position can be input by the user'ssecond operation. In an example in FIGS. 2 to 5, the centering area C isthe same as the bending stop area Y2. When the second operation lastingless than the predetermined duration from touch start until touch end isperformed on the centering area C, the control portion 25 controllablycauses the bending portion 14 to perform a centering operation of beingstraightened.

Operation buttons Bt are displayed in the menu area Mn. The operationbuttons Bt allow instructions to execute predetermined functions to beinput by the user's second operation. The predetermined functionsinclude live image display, final recorded image display, thumbnaildisplay, and the like. The operation buttons Bt may include a freezebutton, a release button, a zoom button, a brightness adjustment button,or a menu button, which are used to execute predetermined functions. Forexample, when the user performs the second operation on the operationbutton Bt causing a live image display instruction to be input, thedisplay screen Y switches to display of a live image. In other words,the menu area Mn is a second area with the operation buttons Bt allowingthe predetermined functions to be executed.

For example, when the user performs the first operation by keeping intouch with an upper part of the bending instruction pattern R1 for thepredetermined duration or more, the bending portion 14 is bent upward.When the user performs the first operation by sliding the finger F alongthe bending instruction pattern R1 from an upper part to a right partthereof as illustrated in an example in FIG. 4, the bending portion 14changes from upward bending to rightward bending to rotate around aproximal end side of the bending portion 14. Even in a case where thefinger F deviates from the bending instruction pattern R1, the user'sbending instruction is input to the touch panel 22 b so long as thefinger F remains within the bending instruction area Y1. When the fingerF slides from the bending instruction area Y1 into the bending stop areaY2 as a result of the first operation as illustrated in an example inFIG. 5, the bending portion 14 stops the bending operation. The user'sfirst operation on the bending stop area Y2 does not cause the bendingportion 14 to perform the bending operation.

That is, the display portion 22 includes the touch panel 22 b to displaythe display screen Y including the endoscope image X acquired by theendoscope 21 including the bending portion 14. When the first operationlasting the predetermined duration or more from touch start until touchend on the display screen Y, the control portion 25 controllably causesthe bending portion 14 to perform the bending operation. When the touchposition in the first operation is in the bending instruction area Y1,the control portion 25 causes the bending portion 14 to perform thebending operation in a bending direction associated with the touchposition.

A program for the bending control portion P causes a computer to executea code for displaying, on the display portion 22 with the touch panel 22b, the display screen Y including the endoscope image X acquired by theendoscope 21 with the bending portion 14 and a code for controllablycausing the bending portion 14 to perform the bending operation when thefirst operation lasting the predetermined duration or more from touchstart until touch end is performed on the display screen Y.

A recording medium includes the program for the bending control portionP recorded therein, the program causing a computer to execute a code fordisplaying, on the display portion 22 with the touch panel 22 b, thedisplay screen Y including the endoscope image X acquired by theendoscope 21 with the bending portion 14 and a code for controllablycausing the bending portion 14 to perform the bending operation when thefirst operation lasting the predetermined duration or more from touchstart until touch end is performed on the display screen Y.

Operation of First Embodiment

Operation of the first embodiment will now be described.

FIG. 6 is a flowchart illustrating an example of a bending controlprocess of the touch panel device 31 according to the first embodimentof the disclosed technology. FIG. 7 is a diagram illustrating an exampleof the first operation of the touch panel device 31 according to thefirst embodiment of the disclosed technology. FIG. 8 is a diagramillustrating an example of the second operation of the touch paneldevice 31 according to the first embodiment of the disclosed technology.

The user activates the touch panel device 31 and inserts the insertionportion 11 of the endoscope 21 into the object. The imaging portion 13images the inside of the object to output a resultant imaging signal tothe image processing portion 15. The image processing portion 15generates the endoscope image X based on the imaging signal to outputthe endoscope image X to the control portion 25. The control portion 25generates the display screen Y based on the endoscope image X to outputthe display screen Y to the display portion 22. The display portion 22displays the display screen Y. The control portion 25 loads the programfor the bending control portion P from the storage portion 25 b toexecute the program.

Whether or not the first operation has been performed on the bendinginstruction area Y1 is determined in S11. The control portion 25 detectsa touch in the bending instruction area Y1 based on a control signalinput from the touch panel 22 b. When detecting a touch, the controlportion 25 drives an internal timer to measure the time until the touchis undetected. When the measured time is the predetermined duration ormore, the control portion 25 determines that the first operation hasbeen performed on the bending instruction area Y1. When it is determinedin YES in S11 that the first operation has been performed on the bendinginstruction area Y1, the process proceeds to S12. On the other hand,when it is determined in NO in S11 that the first operation has not beenperformed on the bending instruction area Y1, the process proceeds toS18.

The bending operation of the bending portion 14 is performed the in S12.The control portion 25 detects the touch position on the bendinginstruction area Y1 based on the control signal input from the touchpanel 22 b. The control portion 25 executes a predetermined calculationto calculate the pulling amount of the pulling members based on thebending direction corresponding to the touch position. The controlportion 25 outputs, to the bending driving portion 16, a bendinginstruction including the pulling amount of the pulling member. Thebending driving portion 16 pulls the pulling members according to thebending instruction to bend the bending portion 14.

Whether or not the menu area Mn has been touched is determined in S13.The control portion 25 determines whether or not the touch position liesin the menu area Mn. When it is determined in NO in S13 that the menuarea Mn has not been touched, the process proceeds to S14. On the otherhand, when it is determined in YES in S13 that the menu area Mn has beentouched, the process proceeds to S16.

Whether or not the bending stop area Y2 has been touched is determinedin S14. The control portion 25 determines whether or not the bendingstop area Y2 has been touched. When it is determined in NO in S14 thatthe bending stop area Y2 has not been touched, the process proceeds toS15. On the other hand, when it is determined in YES in S14 that thebending stop area Y2 has been touched, the process proceeds to S16.

Whether or not the bending instruction area Y1 has been touched isdetermined in S15. The control portion 25 determines whether or not thebending instruction area Y1 has been touched. When it is determined inYES in S15 to that the bending instruction area Y1 has been touched, theprocess returns to S12. On the other hand, when it is determined in NOin S15 the bending instruction area Y1 has not been touched, the processproceeds to S16.

The bending operation of the bending portion 14 is stopped in S16. Thecontrol portion 25 outputs the control signal to the bending drivingportion 16 to stop the bending operation.

Whether or not the touch has ended is determined in S17. The controlportion 25 determines whether or not the touch has ended based on thecontrol signal input from the touch panel 22 b. When the touch on thetouch panel 22 b is undetected, the control portion 25 determines thatthe touch has ended. When the touch has not ended in NO in S17, theprocess returns to S11. On the other hand, when the touch has ended inYES in S17, the bending control process ends.

Whether or not the second operation has been performed on the centeringarea C is determined in S18. The control portion 25 determines, based onthe time measured by the timer and the control signal input from thetouch panel 22 b, whether or not a touch lasting less than thepredetermined duration has been performed in the endoscope image X. Whena touch lasting less than the predetermined duration has been performedin the endoscope image X, the control portion 25 determines in YES inS18 that the second operation has been performed. The process proceedsto S19. On the other hand, when the control portion 25 determines in NOin S18 that the second operation has not been performed, the processreturns to S11.

The centering operation is performed in S19. The control portion 25outputs a centering instruction to the bending driving portion 16. Whenthe centering instruction is input to the bending driving portion 16,the bending driving portion 16 pulls the pulling members to straightenthe bending portion 14. After the centering operation is carried out,the process proceeds to S16.

The process in S11 to S19 is included in the process of the bendingcontrol portion P.

In other words, an endoscope bending control method involves preparingthe display portion 22 with the touch panel 22 b displaying the displayscreen Y, displaying, on the display portion 22, the display screen Yincluding the endoscope image X acquired by the endoscope 21 with thebending portion 14, and controllably causing the bending portion 14 toperform the bending operation when the first operation lasting thepredetermined duration or more from touch start until touch end isperformed on the display screen Y.

For example, when the user performs the first operation on the bendinginstruction area Y1 in S11, the bending portion 14 is bent in S12. As animaged part on the object varies, the endoscope image X also varies soas to scroll on the display screen Y. When, in NO in S13 and YES in S14,the finger F slides into the bending instruction area Y2 as a result ofthe first operation, the bending portion 14 stops the bending operationin S16. When, in NO in S17 and YES in S11, the finger F slides into thebending instruction area Y1 again as a result of the first operation,the bending portion 14 performs the bending operation in S12.

With the user's eyes fixed at the endoscope image X, the user places thefinger F at the approximate position of the bending instruction area Y1.The user subsequently performs the first operation by sliding the fingerF in any direction. The user stores the position of the finger F placedwhen scrolling of the endoscope image X is started or stopped. Thisallows the user to determine a contour of the bending instruction areaY1 based on the stored position of the finger F and in turn todetermine, based on the determined contour, a touch position in thebending instruction area Y1 to be touched to specify the bendingdirection.

Furthermore, when the finger F slides into the menu area Mn as a resultof the first operation in YES in S14 as illustrated in FIG. 7, thebending portion 14 stops the bending operation in S16. The user candetermine the position of the menu area Mn with no need to shift theuser's eyes to the menu area Mn and with the user's eyes fixed at theendoscope image X. This can prevent possible erroneous operation of theoperation buttons Bt.

When, in NO in S11 and YES in S18, the second operation is determined tohave been performed on the centering area C, the bending portion 14performs the centering operation in S19. The user can more reliablyinput the centering instruction with the user's eyes fixed at theendoscope image X.

According to the embodiment, the touch panel device 31 allows thebending portion 14 of the insertion portion 11 to be more accuratelymanipulated by the bending instruction and the centering instructionwith no need to shift the user's eyes to the bending instruction patternR1 or the direction instruction patterns R2 and with the user's eyesfixed at the endoscope image X.

Modified Example of First Embodiment

In the first embodiment, the bending instruction area Y1 is disposedlike a ring concentric with the bending instruction pattern R1. However,the bending instruction area Y1 need not necessarily be disposed like aring concentric with the bending instruction pattern R1.

FIG. 9 is a diagram illustrating an example of the first operation ofthe touch panel device 31 according to a modified example of the firstembodiment of the disclosed technology. FIG. 10 is a diagramillustrating an example of the second operation of the touch paneldevice 31 according to the modified example of the first embodiment ofthe disclosed technology. In the modified example, details of the samecomponents as those of other embodiments and modified examples areomitted. In the other embodiments and modified examples, details of thesame components are also omitted.

As illustrated in FIG. 9, the bending instruction area Y1 a is arrangedoutside the bending instruction pattern R1. In the bending instructionarea Y1 a, touch positions indicating bending directions are arranged inradial directions around the bending instruction pattern R1 (alternateone and short dash lines in FIG. 9). The bending stop area Y2 isarranged inside the bending instruction pattern R1. The centering area Cis arranged all over the endoscope image X.

For example, when the user performs the first operation by sliding thefinger F obliquely downward and leftward in a central part of thebending instruction area Y1 a, the bending portion 14 is bent obliquelydownward and leftward in response to movement of the finger F. When theuser performs the first operation on the bending stop area Y2, thebending portion 14 stops the bending operation.

When the user performs the second operation on the centering area C asillustrated in FIG. 10, the bending portion 14 performs the centeringoperation.

Thus, with the user's eyes fixed at the endoscope image X, the user caninput the instruction to bend the bending portion 14 by performing thefirst operation on the bending instruction area Y1 a and also input theinstruction to center the bending portion 14 by performing the secondoperation on the centering area C.

Second Embodiment

In the first embodiment and the modified example, the display screen Yincludes the menu area Mn. However, the display screen Y need notnecessarily include the menu area Mn.

FIG. 11 is a flowchart illustrating an example of the bending controlprocess of the touch panel device 31 according to a second embodiment ofthe disclosed technology. FIG. 12 is a diagram illustrating an exampleof the first operation of the touch panel device 31 according to thesecond embodiment of the disclosed technology. FIG. 13 is a diagramillustrating an example of the second operation of the touch paneldevice 31 according to the second embodiment of the disclosedtechnology.

In the second embodiment, the endoscope image X is displayed all overthe display screen Y. The bending instruction area Y1 is arranged in alower right part of the endoscope image X. The bending stop area Y2 isarranged inside the bending instruction area Y1. The centering area C isthe same as the bending stop area Y2.

Operation of the second embodiment will be described.

Whether or not the first operation has been performed on the bendinginstruction area Y1 is determined in S21. When the first operation isdetermined in YES in S21 to have been performed on the bendinginstruction area Y1, the process proceeds to S22. On the other hand,when the first operation is determined in NO in S21 not to have beenperformed on the bending instruction area Y1, the process proceeds toS26.

The bending portion 14 is caused to perform the bending operation inS22.

Whether or not the bending stop area Y2 has been touched is determinedin NO in S23. When the bending stop area Y2 is determined in S23 not tohave been touched, the process returns to S22. On the other hand, whenthe bending stop area Y2 is determined in YES in S23 to have beentouched, the process proceeds to S24.

The bending operation of the bending portion 14 is stopped in S24.

Whether or not the touch has ended is determined in S25. When the touchis determined in NO in S25 not to have ended, the process returns toS21. On the other hand, when the touch is determined in YES in S25 tohave ended, the process ends.

Whether or not the second operation has been performed on the centeringarea C is determined in S26. When the second operation is determined inYES in S26 to have been performed on the centering area C, the processproceeds to S27. On the other hand, when the second operation isdetermined in NO in S26 not to have been performed on the centering areaC, the process returns to S21.

The centering operation is performed in S27. After the centeringoperation is carried out, the process proceeds to S24.

The process in S21 to S27 is included in the process of the bendingcontrol portion P.

For example, when the user performs the first operation on the bendinginstruction area Y1 as illustrated in FIG. 12, the bending portion 14performs the bending operation in response to movement of the finger F.

When the user performs the second operation as illustrated in FIG. 13,the bending portion 14 performs the centering operation.

According to the embodiments, the touch panel device 31 can display theendoscope image X wider. This allows the bending portion 14 of theinsertion portion 11 to be more accurately manipulated by the bendinginstruction and the centering instruction with no need to shift theuser's eyes to the bending instruction pattern R1 or the directioninstruction patterns R2 and with the user's eyes fixed at the endoscopeimage X.

Modified Example of Second Embodiment

In the second embodiment, the direction instruction patterns R2 aredisposed in the bending instruction pattern R1 located in the lowerright part of the endoscope image X. However, direction instructionpatterns R2 a may be disposed at peripheral edges of the endoscope imageX.

FIG. 14 is a diagram of the first operation of the touch panel device 31according to a modified example of the second embodiment of thedisclosed technology. FIG. 15 is a diagram of the second operation ofthe touch panel device 31 according to the modified example of thesecond embodiment of the disclosed technology.

As illustrated in FIG. 14, the bending instruction area Yla and thecentering area C are arranged all over the endoscope image X. Theperipheral edges of a display area of the endoscope image X includeeight direction instruction patterns R2 a indicating eight directionsincluding an upward direction, a downward direction, a leftwarddirection, a rightward direction, and oblique direction.

As illustrated by alternate long and short dash lines in FIG. 14, thebending direction of the bending portion 14 is a direction correspondingto the first operation. For example, when the user performs the firstoperation on the bending instruction area Y1 a by sliding the finger Fupward and leftward, the bending portion 14 performs an upward andleftward bending operation in response to the movement of the finger F.

When the user performs the second operation on the centering area C asillustrated in FIG. 15, the bending portion 14 performs the centeringoperation.

Third Embodiment

The first embodiment, the second embodiment, and the modified examplesof the first and second embodiments, the bending instruction pattern R1and the direction instruction patterns R2 and R2 a are disposed on thedisplay screen Y. However, the bending instruction pattern R1 and thedirection instruction patterns R2 and R2 a need not necessarily bedisposed.

FIG. 16 is a flowchart illustrating an example of the bending controlprocess of the touch panel device 31 according to a third embodiment ofthe disclosed technology. FIG. 17 is a diagram illustrating an exampleof the first operation of the touch panel device 31 according to thethird embodiment of the disclosed technology. FIG. 18 is a diagramillustrating an example of the second operation of the touch paneldevice 31 according to the third embodiment of the disclosed technology.

In the third embodiment, the endoscope image X and the menu area Mn aredisposed on the display screen Y.

As illustrated in FIG. 17, the bending instruction area Y1 a and thecentering area C are arranged all over the endoscope image X. When theuser performs the first operation on the bending instruction area Y1 a,the bending portion 14 performs the bending operation in the directioncorresponding to the first operation.

When the user performs the second operation on the centering area C asillustrated in FIG. 18, the bending portion 14 performs the centeringoperation.

Operation of the third embodiment will be described.

Whether or not the first operation has been performed on the bendinginstruction area Y1 is determined in YES in S31. When the firstoperation is determined in S31 to have been performed on the bendinginstruction area Y1, the process proceeds to S32. On the other hand,when the first operation is determined in NO in S31 not to have beenperformed on the bending instruction area Y1, the process proceeds toS35.

The bending portion 14 is caused to perform the bending operation inS32.

The bending operation of the bending portion 14 is stopped in S33.

Whether or not the touch has ended is determined in S34. When the touchis determined in NO in S34 not to have ended, the process returns toS31. On the other hand, when the touch is determined in YES in S34 tohave ended, the bending control process ends.

Whether or not the second operation has been performed on the centeringarea C is determined in S35. When the second operation is determined inYES in S35 to have been performed, the process proceeds to S36. On theother hand, when the second operation is determined in NO in S35 not tohave been performed, the process returns to S31.

The centering operation is performed in S36. After the centeringoperation is carried out, the process proceeds to S33.

The process in S31 to S36 is included in the process of the bendingcontrol portion P.

For example, when the user performs the first operation on the bendinginstruction area Y1 as illustrated in FIG. 17, the bending portion 14 isbent in response to the movement of the finger F.

When the user performs the second operation on the centering area C asillustrated in FIG. 18, the bending portion 14 performs the centeringoperation.

According to the embodiments, the touch panel device 31 can display theendoscope image X wider. This allows the bending portion 14 of theinsertion portion 11 to be more accurately manipulated by the bendinginstruction and the centering instruction with the user's eyes fixed atthe endoscope image X.

Modified Example of Third Embodiment

In the third embodiment, the menu area Mn is disposed on the displayscreen Y. However, the menu area Mn need not necessarily be disposed.

FIG. 19 is a diagram illustrating an example of the first operation ofthe touch panel device 31 according to a modified example of the thirdembodiment of the disclosed technology. FIG. 20 is a diagramillustrating an example of the second operation of the touch paneldevice 31 according to the modified example of the third embodiment ofthe disclosed technology.

As illustrated in FIG. 19, the bending instruction area Y1 a and thecentering area C are arranged all over the endoscope image X. When theuser performs the first operation on the bending instruction area Y1 a,the bending portion 14 performs the bending operation in the directioncorresponding to the first operation.

When the user performs the second operation on the centering area C asillustrated in FIG. 20, the bending portion 14 performs the centeringoperation.

In the first embodiment and the second embodiment, the bendinginstruction pattern R1 illustrated between the outer edge Y1 o and theinner edge Y1 i of the bending instruction area Y1 is disposed like aring concentric with the outer edge Y1 o and the inner edge Y1 i.However, the bending instruction pattern R1 may be disposed to occupythe same area as the bending instruction area Y1.

In the first embodiment, when the first operation is performed on themenu area Mn, the bending portion 14 stops the bending operation.However, with the operation of the bending portion 14 not stopped, themenu area Mn may be moved to a position different from the touchposition.

In the embodiments and the modified examples, the bending portion 14performs the bending operation according to the first operation.However, the bending operation may be stopped in response to stoppage ofmovement of the finger F or may continue even after movement of thefinger F is stopped.

In the embodiments and the modified examples, a bending speed may varyaccording to a swipe speed.

In the embodiments and the modified examples, the bending speed may bereduced by performing the first operation in a direction opposite to thebending direction.

In the embodiments and the modified examples, the endoscope image X mayinclude areas for providing instructions regarding the bending speed,such as an instruction area for high-speed bending, an instruction areafor medium-speed bending, and an instruction area for low-speed bending,the instruction areas allowing the respective instructions to be inputby the first operation.

In the embodiments and the modified examples, the second operation isused to input the centering instruction, and the first operation is usedto input the bending instruction. However, the second operation mayallow input of an angle lock instruction to lock the bending portion 14in a bent state by the second operation. The first operation may allowthe bending instruction to be input.

For the steps of the procedures in the present embodiments, the order ofexecution may be changed, a plurality of the steps may be simultaneouslyexecuted, or the order of execution may be varied for each case ofexecution, unless these modifications are contrary to the nature of thesteps. Moreover, all or some of the steps of the procedures in thepresent embodiments may be implemented by hardware.

In sum, one aspect of the disclosed technology is directed to a touchpanel device used in an endoscope device. The touch panel deviceincludes a display portion having a display panel and a touch panelformed thereto and configured to display an endoscope image on thedisplay panel acquired by an endoscope including a bending portion. Aprocessor is configured to control the bending portion so as to performa bending operation when a user keeps performing a first operation onthe touch panel in a first predetermined duration or more.

The processor is configured to control the bending portion so as toperform a bending operation so that the bending portion is accuratelymanipulated with no need for a user to shift eyes from the endoscopeimage to a manipulation image during an operation. The display paneldisplays a first area with direction instruction patterns indicatingbending directions. The processor directs the bending operation to beperformed in the bending direction associated with a touch position inthe first operation when the touch position is corresponding to thefirst area. The display panel displays a second area inside the firstarea. The processor is configured to stop the bending operation when thefirst operation is performed on the second area via the touch panel. Thedisplay panel displays a centering area. The processor is configured tocontrol the bending portion so that the bending portion is straightenedwhen the user keeps performing a second operation on the centering areavia the touch panel in a second predetermined duration less than thefirst predetermined duration of the first operation. The second area onthe display panel is substantially same as the centering area on thedisplay panels. The centering area on the display panel is an areaoutside the first area on the display panel. The second area on thedisplay panel is disposed inside the first area arranged like a ring onthe display panel. The display panel displays a second area outside thefirst area. The processor stops the bending operation when the firstoperation is performed on the second area via the touch panel.

The display panel displays a centering area and the processor isconfigured to control the bending portion so that the bending portion isstraightened when the user keeps performing a second operation on thecentering area via the touch panel in a duration less than a secondpredetermined duration. The second area is substantially same as thecentering area on the display panel. The second area is disposed insidethe first area arranged like a ring on the display panel. The displaypanel displays a second area in which the processor is configured tostop the bending operation when the user performs the first operation onthe second area via the touch panel. The display panel displays anoperation button for executing a predetermined function in the secondarea. The display panel displays a second area in which the processor isconfigured to stop the bending operation when the user performs thefirst operation on the second area via the touch panel. The displaypanel displays a centering area and the processor is configured tocontrol the bending portion so that the bending portion is straightenedwhen the user keeps performing a second operation on the centering areavia the touch panel in a duration less than the first predeterminedduration. The second area is substantially same as the centering area onthe display panel. The display panel displays a centering area and theprocessor is configured to control the bending portion so that thebending portion is straightened when the user keeps performing a secondoperation on the centering area via the touch panel in a secondpredetermined duration less than the first predetermined duration of thefirst operation.

Another aspect of the disclosed technology is directed to a recordingmedium used in a touch panel device including a bending control programrecorded therein. The bending control program is causing a computer toexecute: a code displaying on a display portion with a touch panel, adisplay screen including an endoscope image acquired by an endoscopehaving a bending portion and a code controls the bending portion so asto perform a bending operation when a user keeps performing a firstoperation on the touch panel in a first predetermined duration or more.

A further aspect of the disclosed technology is directed to an endoscopebending control method comprising the steps preparing a display portionhaving a touch panel displaying a display screen; displaying, on thedisplay portion, the display screen including an endoscope imageacquired by an endoscope having a bending portion; and controlling thebending portion so as to perform a bending operation when a user keepsperforming a first operation on the touch panel in a first predeterminedduration or more.

The disclosed technology is not limited to the embodiments describedhereinbefore. Various changes, alterations, and the like can be made tothe embodiments without departing from the spirits of the disclosedtechnology.

It should be understood by those skilled in the art that variousmodifications, combinations, sub-combinations and alterations may occurdepending on design requirements and other factors insofar as they arewithin the scope of the appended claims or the equivalents thereof.

While various embodiments of the disclosed technology have beendescribed above, it should be understood that they have been presentedby way of example only, and not of limitation. Likewise, the variousdiagrams may depict an example schematic or other configuration for thedisclosed technology, which is done to aid in understanding the featuresand functionality that can be included in the disclosed technology. Thedisclosed technology is not restricted to the illustrated exampleschematic or configurations, but the desired features can be implementedusing a variety of alternative illustrations and configurations. Indeed,it will be apparent to one of skill in the art how alternativefunctional, logical or physical locations and configurations can beimplemented to implement the desired features of the technologydisclosed herein.

Although the disclosed technology is described above in terms of variousexemplary embodiments and implementations, it should be understood thatthe various features, aspects and functionality described in one or moreof the individual embodiments are not limited in their applicability tothe particular embodiment with which they are described, but instead canbe applied, alone or in various combinations, to one or more of theother embodiments of the disclosed technology, whether or not suchembodiments are described and whether or not such features are presentedas being a part of a described embodiment. Thus, the breadth and scopeof the technology disclosed herein should not be limited by any of theabove-described exemplary embodiments.

Terms and phrases used in this document, and variations thereof, unlessotherwise expressly stated, should be construed as open ended as opposedto limiting. As examples of the foregoing: the term “including” shouldbe read as meaning “including, without limitation” or the like; the term“example” is used to provide exemplary instances of the item indiscussion, not an exhaustive or limiting list thereof; the terms “a” or“an” should be read as meaning “at least one”, “one or more” or thelike; and adjectives such as “conventional”, “traditional”, “normal”,“standard”, “known” and terms of similar meaning should not be construedas limiting the item described to a given time period or to an itemavailable as of a given time, but instead should be read to encompassconventional, traditional, normal, or standard technologies that may beavailable or known now or at any time in the future. Likewise, wherethis document refers to technologies that would be apparent or known toone of ordinary skill in the art, such technologies encompass thoseapparent or known to the skilled artisan now or at any time in thefuture.

The presence of broadening words and phrases such as “one or more”, “atleast”, “but not limited to” or other like phrases in some instancesshall not be read to mean that the narrower case is intended or requiredin instances where such broadening phrases may be absent. Additionally,the various embodiments set forth herein are described in terms ofexemplary schematics, block diagrams, and other illustrations. As willbecome apparent to one of ordinary skill in the art after reading thisdocument, the illustrated embodiments and their various alternatives canbe implemented without confinement to the illustrated examples. Forexample, block diagrams and their accompanying description should not beconstrued as mandating a particular configuration.

What is claimed is:
 1. A touch panel device used in an endoscope devicecomprising: a display portion having a display panel and a touch panelformed thereto and configured to display an endoscope image on thedisplay panel acquired by an endoscope including a bending portion; anda processor configured to control the bending portion so as to perform abending operation when a user keeps performing a first operation on thetouch panel in a first predetermined duration or more and wherein thedisplay panel displays respective concentric first and second areas inwhich the second area being disposed inside the first area forming aring configuration with direction instruction patterns indicatingbending direction therebetween and the processor directs the bendingoperation to be performed in the bending direction associated with atouch position in the first operation when the touch position iscorresponding to the first area and wherein the processor beingconfigured to stop the bending operation when the user swipes on thedirection instruction patterns in the second area; wherein the processorchanges a speed of the bending operation of the bending portionaccording to an operation speed of the first operation.
 2. The touchpanel device of claim 1, wherein the processor is configured to controlthe bending portion so as to perform a bending operation so that thebending portion is accurately manipulated with no need for a user toshift eyes from the endoscope image to a manipulation image during anoperation.
 3. The touch panel device of claim 1, wherein the displaypanel displays a centering area, and the processor is configured tocontrol the bending portion so that the bending portion is straightenedwhen the user keeps performing a second operation on the centering areavia the touch panel in a second predetermined duration less than thefirst predetermined duration of the first operation.
 4. The touch paneldevice of claim 3, wherein the second area on the display panel issubstantially same as the centering area on the display panels.
 5. Thetouch panel device of claim 3, wherein the centering area on the displaypanel is an area outside the first area on the display panel.
 6. Thetouch panel device of claim 1, wherein the display panel displays asecond area outside the first area, and the processor stops the bendingoperation when the first operation is performed on the second area viathe touch panel.
 7. The touch panel device of claim 6, wherein thedisplay panel displays a centering area, and the processor is configuredto control the bending portion so that the bending portion isstraightened when the user keeps performing a second operation on thecentering area via the touch panel in a duration less than a secondpredetermined duration.
 8. The touch panel device of claim 7, whereinthe second area is substantially same as the centering area on thedisplay panel.
 9. The touch panel device of claim 1, wherein the displaypanel displays a second area wherein the processor is configured to stopthe bending operation when the user performs the first operation on thesecond area via the touch panel, and the display panel displays anoperation button for executing a predetermined function in the secondarea.
 10. The touch panel device of claim 1, wherein the display paneldisplays a second area wherein the processor is configured to stop thebending operation when the user performs the first operation on thesecond area via the touch panel.
 11. The touch panel device of claim 10,wherein the display panel displays a centering area, and the processoris configured to control the bending portion so that the bending portionis straightened when the user keeps performing a second operation on thecentering area via the touch panel in a duration less than the firstpredetermined duration.
 12. The touch panel device of claim 11, whereinthe second area is substantially same as the centering area on thedisplay panel.
 13. The touch panel device of claim 1, wherein thedisplay panel displays a centering area, and the processor is configuredto control the bending portion so that the bending portion isstraightened when the user keeps performing a second operation on thecentering area via the touch panel in a second predetermined durationless than the first predetermined duration of the first operation.
 14. Acomputer program product in a form of recording medium, used in a touchpanel device, including a non-transitory computer readable medium havinga bending control program code encoded thereon that when executed by aprocessor of a computer, the bending control program causes the computerto execute: a code displaying, on a display portion having a displayscreen and a touch panel formed thereto, the display screen includes anendoscope image acquired by an endoscope having a bending portion; acode controls the bending portion so as to perform a bending operationwhen a user keeps performing a first operation on the touch panel in afirst predetermined duration or more and wherein the display screendisplays respective concentric first and second areas in which thesecond area being disposed inside the first area forming a ringconfiguration with direction instruction patterns indicating bendingdirection therebetween and the processor directs the bending operationto be performed in the bending direction associated with a touchposition in the first operation when the touch position is correspondingto the first area and wherein the processor being configured to stop thebending operation when the user swipes on the direction instructionpatterns in the second area; and a code changing a speed of the bendingoperation of the bending portion according to an operation speed of thefirst operation.
 15. An endoscope bending control method comprising:preparing a display portion having a touch panel displaying a displayscreen; displaying an endoscope image acquired by an endoscope on thedisplay screen, the endoscope includes a bending portion configured tocommunicate with a bending driving portion and a bending control portionhaving codes of a bending control process to control the bending drivingportion in accordance to instructions input via the touch panel; andcontrolling the bending portion so as to perform a bending operationwhen a user keeps performing a first operation on the touch panel in afirst predetermined duration or more and wherein the display screendisplays respective concentric first and second areas in which thesecond area being disposed inside the first area forming a ringconfiguration with direction instruction patterns indicating bendingdirection therebetween and a processor directs the bending operation tobe performed in the bending direction associated with a touch positionin the first operation when the touch position is corresponding to thefirst area and wherein the processor being configured to stop thebending operation when the user swipes on the direction instructionpatterns in the second area; and changing a speed of the bendingoperation of the bending portion according to an operation speed of thefirst operation.
 16. A touch panel device used in an endoscope devicecomprising: a display portion having a display panel and a touch panelformed thereto and configured to display an endoscope image on thedisplay panel acquired by an endoscope including a bending portion; anda processor configured to control the bending portion so as to perform abending operation when a user keeps performing a first operation on thetouch panel in a first predetermined duration or more and wherein thedisplay panel displays respective concentric first and second areas inwhich the second area being disposed inside the first area forming aring configuration with direction instruction patterns indicatingbending direction therebetween and the processor directs the bendingoperation to be performed in the bending direction associated with atouch position in the first operation when the touch position iscorresponding to the first area and wherein the processor beingconfigured to stop the bending operation when the user swipes on thedirection instruction patterns in the second area; wherein the processorreduces a speed of the bending operation when the user performs thefirst operation in a direction opposite to the bending direction of thebending portion.
 17. A computer program product in a form of recordingmedium, used in a touch panel device, including a non-transitorycomputer readable medium having a bending control program code encodedthereon that when executed by a processor of a computer, the bendingcontrol program causes the computer to execute: a code displaying, on adisplay portion having a display screen and a touch panel formedthereto, the display screen includes an endoscope image acquired by anendoscope having a bending portion; a code controls the bending portionso as to perform a bending operation when a user keeps performing afirst operation on the touch panel in a first predetermined duration ormore and wherein the display screen displays respective concentric firstand second areas in which the second area being disposed inside thefirst area forming a ring configuration with direction instructionpatterns indicating bending direction therebetween and the processordirects the bending operation to be performed in the bending directionassociated with a touch position in the first operation when the touchposition is corresponding to the first area and wherein the processorbeing configured to stop the bending operation when the user swipes onthe direction instruction patterns in the second area; and a codereducing a speed of the bending operation when the user performs thefirst operation in a direction opposite to the bending direction of thebending portion.
 18. An endoscope bending control method comprising:preparing a display portion having a touch panel displaying a displayscreen; displaying an endoscope image acquired by an endoscope on thedisplay screen, the endoscope includes a bending portion configured tocommunicate with a bending driving portion and a bending control portionhaving codes of a bending control process to control the bending drivingportion in accordance to instructions input via the touch panel; andcontrolling the bending portion so as to perform a bending operationwhen a user keeps performing a first operation on the touch panel in afirst predetermined duration or more and wherein the display screendisplays respective concentric first and second areas in which thesecond area being disposed inside the first area forming a ringconfiguration with direction instruction patterns indicating bendingdirection therebetween and a processor directs the bending operation tobe performed in the bending direction associated with a touch positionin the first operation when the touch position is corresponding to thefirst area and wherein the processor being configured to stop thebending operation when the user swipes on the direction instructionpatterns in the second area; and reducing a speed of the bendingoperation when the user performs the first operation in a directionopposite to the bending direction of the bending portion.